Sync in Complex Dynamical Networks: Stability, 
Evolution, Control, and Application 

Xiang Li* 

Department of Automation 
Sliangliai Jiao Tong University 
Dongchuan Road 800, Shanghai 200240, P.R.China 

(Invited Review for International Journal of Computational Cognition) 

February 2, 2008 

Abstract 

In the past few years, the discoveries of smaU-world and scale-free properties of many natural and 
artificial complex networks have stimulated significant advances in better understanding the rela- 
tionship between the topology and the collective dynamics of complex networks. This paper reports 
recent progresses in the literature of synchronization of complex dynamical networks including stabil- 
ity criteria, network synchronizability and uniform synchronous criticality in different topologies, and 
the connection between control and synchronization of complex networks as well. The economic-cycle 
synchronous phenomenon in the World Trade Web, a scale-free type of social economic networks, is 
used to illustrate an application of the network synchronization mechanism. 
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1 Introduction 

Synchronization is a long-lasting fundamental concept and is, in fact, a universal phenomenon in all areas 
of science and technology ^| |^ EOl EHl [ZS| • There are many interesting synchronization phenomena 
seen in our daily life, including for example fireflies flashing in unison, crickets chirping in synchrony, and 
heart cells beating in rhythm. 

One of the most significant and interesting properties of a dynamical network is the synchronous output 
motion of its network elements (nodes). Synchronization in coupled dynamical networks and systems has 
been studied for many years within a common framework based on nonlinear dynamical system theories, 
due to its ubiquity in many technological fields such as coupled laser systems, biochemical systems, 
and communication networks. In recent years, synchronization in a network of coupled chaotic systems 
has become a topic of great interest |54l I76j . It has been observed, however, that most existing work 
have been concentrated on networks with completely regular topological structures such as chains, grids, 
lattices, and fully-connected graphs. Two typical cases are the discrete-time coupled map lattices |34| 
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and the continuous-time cellular nonlinear networks JH] • The main benefit of these simple architectures 
is that it allows one to focus on the complexity caused by the nonlinear dynamics of the nodes, without 
considering additional complexity caused by the network structure itself. Another appealing feature is the 
possibility of realizing such regularly coupled networks by integrated circuits, with the obvious advantage 
of compactness, for potential engineering and technological applications. 

The topology of a network often affects its functional behaviors. For instance, the topology of a social 
network affects the spreading of information and also disease, while an unsuitable topology of a power 
grid can damage its robustness and stability. In fact, we are confronting all kinds of networks with 
complex structures everyday, where handy instances are the Internet and the World Wide Web (WWW). 
Therefore, people are particularly interested in the question of how to model such complex networks. 
Traditionally, the topology of a complex network is described by a completely random network generated 
by the so-called Erdos-Rcnyi {ER) model [201, which is at the opposite end of the spectrum from a 
completely regular network, and is one of the oldest and perhaps also the best tools for study. However, 
with the increasing interest in trying to understand the essence of various real-life complex networks such 
as the Internet, the World Wide Web, the metabolic networks, and various social and economic networks 
like the scientific-collaboration network and the World Trade Web, etc. [1 UHl HH US E21 El), 
people have discovered the so-called small-world phenomena and scale-free feature, which cannot be well 
described by the ER random graph theory, and therefore stimulate a strong desire of building new network 
models [El EHl E3 EEl • 

Watts, Strogatz and Newman (WSN), for example, introduced their small-world network models, which 
generate networks having short average path lengths along with large clusters [SSI El IZ2] ■ These new 
models show a transition from a regular network to a random network. Both the ER random graph and 
WSN small-world network models have a common Poisson connectivity distribution and arc homogenous 
in nature: each node in such networks has about the same number of connections. Another significant 
discovery is the scale-free feature in a number of real-life complex networks, whose connectivity distri- 
butions are in the power-law form as first pointed out by Barabasi and Albert (BA) jJl jS] . Owing to 
the non-homogenous topology, i.e., most nodes have very few connections and only very few nodes have 
many connections, scale-free networks show a unique characteristic: robustness and yet fragility (see 
[51 117L 1^ 167) for more precise interpretations). The aforementioned small- world and scale- free features 
have also been empirically verified to fit many real-life complex networks: they arc largely clustered with 
a short path length, following a power-law degree distribution. 

The discovery of the small-world effect and scale-free feature of most complex networks has led to a 
fascinating set of common problems concerning how a network structure facilitates and constrains the 
network collective behaviors. In particular, a lot of work have been concentrated on synchronization in 
small- world and scale- free dynamical networks, including small- wo r Id networks of oscillators p i^l^ 
[HHl [Z2] J small- world neural networks [^ El , small- world circle map lattices ^01 , coupled map lattices 
with small- world interactions [201 [SHI j and scale- free networks of oscillators 001 [SHI I58L [HZ] and maps 
[51 1321 1^ . Not limited to the above, synchronous phenomena in complex networks with time delays 
[11[IH1[2Z1[1SI, time- varying coupling [TTl [12 [13 [IE [13 , and weighted coupling [T11[S21[12| have been 
extensively investigated, along with which many network evolving factors have been understood to play 
an important role of synchrony improvements [^ 1221 1281 1291 1501 1511 1581 1771 . Of particular interest 
in real applications is the synchronization phenomenon in the scale-free World Trade Web studied [41) . 
which will be further introduced in this article below. 

Although this survey can only cover a small part of recent progresses in this fast developed literature, 
we wish it could show the audience that current wide studies of complex networks will continuously 
motivate more efforts devoted to the understanding of synchronization and many other aspects of various 
complex dynamical networks and systems. 
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2 Preliminaries: several models of complex network topologies 



2.1 ER model: random networks 

The ER model of random networks [20] is defined as a random graph (network) having labcUcd nodes 
connected by n edges, which are chosen randomly from all the ^^^"^-^ possible edges. The network 
evolves as follows: Start with N nodes, and every pair of nodes are connected with the same probability 
p, as shown in Figrn'o^ 




Figure 1: Evolution of an ER random network. One starts with isolated nodes in (a), and connects every 
pair of nodes with probability (b)p = 0.1, (c) p = 0.15, and (d) p = 0.25, respectively (After 




Figure 2: The degree distribution that results from the numerical simulation of an ER random network, 
which is generated with N ~ 10, 000 and connection probability p — 0.0015 (After [2]). 

The main goal of the random graph theory is to determine, under what connectivity probability p, 
a particular property of a graph (network) will likely arise. For a large N , the ER model generates a 
homogenous random network, whose connectivity approximately follows a Poisson distribution described 
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by (Fig. 13 



m«e-WA^ (1) 

where (fc) is the average of fcj, the degree of node i, over all nodes in the network . With this connectivity 
distribution, nodes in the network are quite uniformly spread out. which is known as a homogenous 
feature of the distribution. 

2.2 WS and NW models: small-world networks 

Recall the evolving algorithm of the WS model [7T] described as follows: (I) Start with a ii'— nearest- 
neighbor coupled network consisting of N nodes arranged in a ring, and each node i is adjacent to its 

neighbor nodes i ± 1, i ± 2, , i ± K/2, where K is even. In order to have a sparse but connected 

network, assume 1 < fc <gC iV in general. (II) Randomly rewire each edge of the network with probability 
p. Rewiring in this context means shifting one end of the edge to a new node chosen at random from the 
whole network, with the constraint that no two different nodes can have more than one edge in between, 
and no node can have an edge with itself. There arc three prominent network evolving phases in the 
WS small- world model: when p = 0, the WS evolving network stays at the original state of a regular 
ring; when p = 1, the WS network evolves to a completely random network; only when < p <C 1, a 
small-world network emerges from the WS model. 

To avoid leading to the formulation of isolated clusters, which may happen in the WS model, Newman 
and Watts proposed their NW small- world model as a variant of the WS model [HZj, which evolves as 
follows: (I) Start with a iV-node regular ring in which every node is connected to its first K neighbors 
{K/2 on each side). Here also 1 < K <^ N. (II) Instead of rewiring in the WS model, add a new 
long-range edge (short-cut) into the network with probability < p <^ 1 between randomly chosen pair 
of nodes. 




Figure 3: Network evolution of small-world models: (a) The WS model with the rewiring of edges, (b) 
The NW model with the addition of edges. (After (HEI)- 

It has been well known that only for sufhcicnt large N and very small p, the NW model is then equivalent 
to the WS model; and networks so-generated are hereby in the category of small-world networks having 
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both short average distances and large clusters (Fig. EJ. Both the WS model and the NW model generate 
small- world networks having the same degree distribution as that of random networks shown in Fig|21 



2.3 BA model: scale-free networks 

The algorithm of the Barabsi- Albert (BA) scale- free model is in the following (I) Growth: Starting 
with a small number (mo) of nodes, at every time step, add a new node with m (< ttiq) edges that link 
the new node to m different nodes already presented in the network. (II) Preferential attachment: When 
choosing the nodes to which the new node connects, assume that the probability 11^ that a new node will 
be connected to node i depends on the degree ki of node i, in such a way that 

^ Y^V (2) 

After t time steps, we get a network having mo + t nodes and mt edges. This network arrives at 
a scale-invariant state with the probability that a node has k edges following a power-law distribution 
P{k) ^ 2m?k~^'^^ with an exponent ^ba = 3 (Fig. 0}, where the scaling exponent ^ba is independent of 
parameter m and the network scale A^, and in this scale-invariant sense the network is said to be scale- free. 
It has been argued that the BA scale-free network model has captured two basic mechanisms, growth 
and preferential attachment, responsible for the scale-free feature and "rich gets richer" phenomenon in 
many real- life and large-scale complicated networks 




Figure 4: Degree distribution P(fc)of scale-free networks generated by the BA model, with A^ = mo + t = 
10000 and m = mo = 1, 3, 5, 7, respectively. 
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3 Stability criteria of dynamical network synchronization 



3.1 The criterion of AAr/A2 

Consider a network having N identical, diffusively coupled nonlinear oscillators as follows in which 
each node is an n-dimensional continuous-time dynamical system: 

N 

X, = /(x,) + c^ayff(xj), z = l,2,--- ,iV, (3) 

where x^ = [xn, Xi2, ... , Xm]'^ € 'Si'" are the state variables of node i, the constant c > represents the 
coupling strength of the network, and 7? S 3?"^" is the output matrix of each node. The coupling matrix 
A = (uij) € Si^^^ represents the coupling configuration of the network: if there is a connection between 
node i and node j, then = 1; otherwise, a^j = (i ^ j). Moreover, an ~ ^ki. 
The coupled network Q is said to achieve (asymptotical) synchronization if 

xi(t) ~ X2{t) ~ ■ ■ ■ ~ xjv(t) s{t), as t — *■ cxD, (4) 

where s(t) 6 3?" can be an equilibrium point, a periodic orbit, and even a chaotic orbit, depending on 
the interest of study. 

Suppose that the network is connected without isolate clusters, whose coupling matrix A is therefore 
a symmetric irreducible matrix. In this case, zero is an eigenvalue of A with multiplicity 1 and all the 
other real eigenvalues of A are strictly negative [7S], denoted by 

= Ai > A2 > As > • • • > Aw . 

Diagonalize the variation equation of network Q, which yields 

i = [Df{s) + c\DHism, i = l,2,-.. ,iV, (5) 

where € 3?" is the transversal error of node i to the synchronized states Q . 

Denote cA^ ~ a + i(3, where a > Q, (3 = 0. The variation equation (|3J) comes to the so-called Master 
Stability Equation of network Q: 

i,^[Dfis) + aDHis)]C^, i = l,2,... ,iV, (6) 

whose largest Lyapunov exponent Lmax is a function of a (and /? = 0), the Master Stability Function 

If for every nonzero eigenvalue Ai, i = 2, ■ • ■ , A^, the corresponding L\^^^ < 0, and the synchronized 
states Q are then stable. Having scaling transformations with the ordered eigenvalues Xi, i — 2, ■ ■ ■ ,N, 
we finally arrive at the following group of inequalities: 



CA2 < ~ ai 



(7) 



Therefore, to achieve the stable synchronized states (@J, Barahona and Pecora stated that the following 
inequality should be satisfied 0: 

^ < ^ (8) 
A2 ai 
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3.2 The criterion of A2 

Wang, Li, and Chen considered the network (PJ of identical, Unearly and diffusively coupled nodes 

gOlinZlEHl: 

TV 

:=/(x,)+c^ayrXj, 2 = 1,2,--- ,iV, (9) 
i=i 

where the inner linking matrix T — diag(ri, • • ■ , Vji ) is a constant 0-1 diagonal matrix linking the coupled 
variables, i.e., the matrix H in network Q is a linear diagonal matrix F. 

Wang and Chen ^6,7,. showed the audience the following theorem in the sense of Lyapunov stability. 

Theorem 1 Suppose there exists an n x n diagonal matrix P > and two constants d < and r > 0, 
such that 

[Dfisit)) + drfP + P[Df{s{t)) + dV] < -Tin 



for all d < d, where In ^ is a unity matrix. If 

77 

(10) 



c > 



then the synchronized states ^ of dynamical network ^ are exponentially stable. 

Further specify F = /„, and assume each node (an n dimensional continuous-time dynamical system) is 
chaotic, whose largest Lyapunov exponent is hmax > 0. The following theorem pointed out the analytic 
value of constant d = —hmax |40) . 

Theorem 2 Consider the network 0) having N identical chaotic systems, where T ~ In- If 

then the synchronized states ^ of dynamical network 0) are exponentially stable. 

Two criteria of and A2 are not contradictory. In fact, when we set H — In in the variational 

equation (jSj), there is a bridge between the largest Lyapunov exponent Lmax of network Q and the 
largest Lyapunov exponent h^ax of each chaotic node in the network: 

LrnaxiK) ^ hmax + cXi, » = 1, 2, • • • , A^, (12) 

which finally reaches the same A2 criterion of Eq. Hll|) . Extended from these two synchronization criteria, 
networks are proposed to be categorized to two classes with their corresponding synchronizability |35|. 

3.3 The case of discrete-time coupled networks 

Consider the following discrete-time form of a complex network with coupled maps: 

TV 

x,(fc + l) = /(x,(fc))+c^a,j/(x,), i = l,2,--- ,iV, (13) 

where corresponding variables are defined in previous sections. Similarly, the discrete-time coupled net- 
work H13[l is said to achieve (asymptotical) synchronization if 

Xi(fc) = X2(fc) = ■ • • = XN{k) s{k), as fc — > 00. (14) 

The counterpart of Theoren^2 for discrete-time coupled network H13() is as follows 001 ■ 
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Theorem 3 Consider the chaotic network U,y\) having N identical coupled maps. If 

1 - e^'*"" 1 



IA.I ^''^ 

then the synchronized states of dynamical network are exponentially stable. 

Therefore, condition (|15|l can be re- written in the form of master stability fimction (jSj), with ai = 
1 — 6"''""'=" , q;2 = 1 + e^'''""^ in this specified case. 

Some latest extensions of network (0 with time-delays |SZI BSj and time- varying embedments 0^1 QZ| 
have been investigated, whose stability conditions still belong to the A2 criterion as that of the origin 0. 
More closely, some researchers have noticed the synchronization stability in the framework of graph theory 
pi llllIT^ . which, although not covered in this paper, deserves more attention and future explorations. 



4 Synchronizability of complex evolving networks 

4.1 Synchronizability of small- world networks 

Given the dynamics of an isolate node and the inner linking structural matrix, the synchronizability of 
the dynamical network J^, with respect to a specific coupling configuration, is said to be strong if the 
network can synchronize with a small value of the coupling strength c in condition 

The second-largest eigenvalue of the coupling matrix in a globally coupled network is —N. This implies 
that for any given and fixed nonzero coupling strength c, a globally coupled network will synchronize 
as long as its size N is large enough. On the other hand, the second-largest eigenvalue of the coupling 
matrix of a nearest-neighbor coupled network tends to zero as —> 00, which implies that for any given 
and fixed nonzero coupling strength c, a nearest-neighbor coupled network cannot synchronize if its size 

is sufficiently large [STll^ . 

Now, consider the dynamical network Q with the NW small- world connections. Let \2sw be the 
second-largest eigenvalue of the coupling matrix A. It was found that |68j . for any given coupling strength 
c: (i) for any N > \d\/ c, there exists a critical value p such that \ip < p <1 then the small-world network 
will synchronize; (ii) for any given p £ (0, 1], there exists a critical value N such that if N > N then the 
small-world network will synchronize. These results imply that the ability of achieving synchronization 
in a large-size nearest-neighbor coupled network can be greatly enhanced by just adding a tiny fraction of 
distant links, thereby making the network a small-world. This also reveals an advantage of small-world 
networks for achieving synchronization, if desired. 

4.2 Synchronizability of scale-free networks: Robust and yet fragile 

Consider the dynamical network again, but with BA scale-free connections instead. It was found |f>7j 
that the second-largest eigenvalue of the corresponding coupling matrix is very close to — 1 , which actually 
is the second-largest eigenvalue of star-shaped coupled networks. This implies that the synchronizability 
of a scale-free network is about the same as that of a star-shaped coupled network. It may be due to 
the extremely inhomogeneous connectivity distribution of such networks: a few "hubs" in a scale-free 
network play a similar important role as a single center in a star-shaped coupled network. 

The robustness of synchronization in a scale- free dynamical network has also been investigated |67) . 
against either random or specific removal of a small fraction 6 of nodes from the network. Obviously, the 
removal of some nodes from network Q will change the coupling matrix. If the second-largest eigenvalue 
of the coupling matrix remains unchanged, then the synchronization stability of the network will remain 
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Figure 5: Network synchronization robustness against random failures: changes of A2 of the BA scale-free 
networks (solid line with circles) , the synchronization-optimal networks (dotted line with diamonds) , the 
ER random networks (solid line with stars), and the synchronization-preferential networks (dash-dotted 
line with squares) when a fraction (5 of randomly selected nodes are removed. All curves are averaged 
from 5 groups of networks in simulations. 



unchanged after the removal of such a node. Let A e 5R^^^ and A e 5R^^^ be the coupling matrices 
of the original network with N vertices and the new network after removal of vertices, respectively. 
Denote A2 and A2 as the second-largest eigenvalues of A and A, respectively. 

It was found |()7| that even when as many as 5% of randomly chosen nodes are removed, the second- 
largest eigenvalue of the coupling matrix, A2, remains almost unchanged; therefore, the ongoing synchro- 
nization is not altered. On the other hand, although the scale-free structure is particularly well-suited 
to tolerate random errors, it is also particularly vulnerable to deliberate attacks. In particular, under an 
intentional attack, the magnitude of A2 decreases rapidly; for example, it almost decreases to one half of 
its original value of A2 in magnitude, when only 1% fraction of the highly connected nodes were removed. 
Therefore, it is very reasonable to believe that the error tolerance and attack vulnerability of synchroniz- 
ability in scale-free networks are rooted in their extremely inhomogeneous connectivity patterns. 



4.3 Synchronizability preference and network robustness 

However, the preference attachment in the BA model of scale-free networks may not directly result 
in its fragility to specific removal of a small fraction of (highly connected) nodes. We make further 
exploring with the introduction of synchronous preferential attachment mechanism into the BA model, 
and the probability 11^ with which the new node is connected to node i depends on the synchronizability 
(characterized by A2i) of the new network if the new node had connected to node i , such that |21j 

n, = (16) 

A2j 

After t <^ mo time steps, we obtain a synchronization-preferential network with niQ + t nodes and mt 
edges. 

An extreme case is that instead of the preferential attachment (|16() . when a new node is added to 
the network, the criterion for choosing the m nodes to which the new node connects is to maximize the 
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synchronizability of the obtained network, or equivalently, to minimize the second-largest eigenvalue of 
the corresponding coupling matrix, which comes to a synchronization-optimal network j22) . 

Now we consider the robustness of synchronization in dynamical network (j^ against either random 
or specific removal of a small fraction S of vertices in these newly proposed networks. In extensive 
numerical simulations, it has been shown that for the synchronizability of a synchronization-preferential 
network, its error tolerance to random removal is a little better than that of a BA scale-free network. 
The value of A2 decreased from -1.2493 to -0.800 when 5% of the vertices were randomly removed, which 
has none significant reduction when more nodes were randomly removed. This implies that the proposed 
synchronization-preferential model is robust against random failures. 

Move to the synchronization fragility of the synchronization-preferential network with respect to de- 
liberate attacks. At every time step, we remove the nodes with the highest degree and found that the 
second-largest eigenvalue of coupling matrix decreased from -1.2493 to -0.3802 when as many as 5% of 
the most connected nodes were removed on purpose. Furthermore, the decreased magnitude of A2 of a 
synchronization-preferential network is smaller than that of a BA network. Therefore, a synchronization- 
preferential network is less vulnerable to specific removal of those most connected nodes than a BA 
scale-free network. 
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Figure 6: Network synchronization fragility against specific attacks: changes of A2 of the largest cluster 
in the B A scale- free networks (solid line with circles) , the synchronization-optimal networks (dotted line 
with diamonds), the ER random networks (solid line with stars), and the synchronization-preferential 
networks (dash-dotted line with squares), when a fraction S of the most connected nodes are purposely 
removed. All curves are averaged from 5 groups of networks in simulations. 

These conclusions could be visualized through the comparisons of the robustness and fragility of 
synchronizability among the ER model, the BA model, the synchronization-optimal model, and the 
synchronization-preferential model (Figs. I5lt)|) . The illustrations imply that the preferential attachment 
mechanism does not necessarily lead to the robust-and-yet-fragile "Achilles heel" of (BA) scale-free net- 
works. 

4.4 Synchronizability of growing networks 

The existence of lower bound and upper bound of the coupling strength c in inequality H15() for syn- 
chronizing discrete-time networks is similar to the master stability synchronization in continuous-time 
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network. Here, through the instance of discrete-time dynamical networks, we investigate the effect of 
growing mechanism on the network synchronization. 

Define R := j^E^, which measures the distance from the first eigenvalue to the main part of the 
spectral density p{X) normalized by the extension of the main part \2'6\. Therefore, the invalidity of 
condition (|15|) equals to the following inequality is satisfied 



1 2e~'' 



(17) 



i.e., to synchronize such a coupled dynamical network of maps, the connection density of the network 
should satisfy the bound determined by its individual nodes. 

As an example of the basic BA model for scale-free networks, with the growing mechanism of adding 
new nodes one by one, there exists a maximum synchronous network scale Nmax (Fig- 0)- A network 
generated by the BA model will not synchronize if the network further expands to have more than N^ax 
nodes, because the condition (|15|l is then no longer satisfied ^U]- For example, if each node is a Hcnon 
map, 



y{k) = -lAy{k - if + 0.3y{k - 2) + 1.0 , 



the maximum network scale Nmax 
(Fig. 



4 for the positive Lyapunov exponent of the map: h,- 



(18) 
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Figure 7: Distribution of the maximum scale-free network size Nmax versus h^ax in [0.1, 1.0] (averaged 
output of 20 random groups) by the BA model with m = mo ~ 1. 

Therefore, there are two conditions to be satisfied for synchronizing a discrete-time dynamical network: 
the network scale N < Nmax and the inequality (|15|l |40| . For example, as stated before, the value Nmax 
of a network of coupled Henon maps for achieving synchronization is 4. Given a 4-node network of 
coupled Hcnon maps in a star-shaped structure, condition (|15|l is further changed to 



IA2I 



0.3416 < c < 



0.4146. 



So, if the coupling strength c is less than 0.3416 or larger than 0.4146, this 4-nodc star of coupled 
Henon maps cannot synchronize although its network scale TV < Nmax ~ 4. However, if the coupling 



11 




strength is suitable for synchronization, i.e., 0.3416 < c < 0.4146, but a new Hcnon node is added to 
the synchronized 4-node star, thereby obtaining a 5-node network (thus, N > N^ax — 4), which cannot 
achieves synchronization finahy. 

5 From synchronization to control 

Now we want to stabihze network ^ onto a homogeneous stationary state defined by 

xi = X2 = • • • = xjv = X, /(x) = 0. (19) 

To achieve such a goal (jl9|l . we apply feedback controllers on a small fraction (5(0 < S ^ 1) of the nodes 
in network Suppose that nodes 11,12, ■■■ ,ii are selected, where I = [SN\ stands for the smaller but 
nearest integer to the real number SN. This controlled network can be described in the re-ordered form: 

Xt = f{xi) + cJ2 Oijrxj - cdT{xi - x), i = 1, 2, • • • , / 

'=^' (20) 
±, = /(x,) +cJ2 a^j-rxj-, i^l + l,l + 2,--- ,N 

where feedback control gain d > 0. Generally, the number of controllers is preferred to be very small 
compared with the whole network scale N, i.e., I ^ N, and the feedback control method in controlled 
network H20() is the so-called pinning control |43[I69| . Through this section, we mainly show a bridge over 
the pinning control of complex networks and the network synchronization |43) . 

Owing to the local error-feedback nature of each pinned node, it is guaranteed that, as the feedback 
control gain d —> 00, the states of the I controlled nodes can be pinned to the homogenous target state 
X. Hence, the pinning control stability of network 120() is converted to that of the following virtually 
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controlled network, and those pinned nodes function as virtual controllers to those un-pinned nodes: 

{Xj = X, i = l,2,...,l 
N _ (21) 
= f{Xi) + C J2 bijTKj +U^, l^l + l,l + 2,...,N ^ ' 

j=l+l 

where the virtual control laws are taken as 

= -cdi (x, - x) , i = l + l,l + 2,...,N (22) 

with the virtual control feedback gains di ~ ^ a,;j, and B = \ hij \ G ii;(^^')x(^-0 defined as 




(A) (b) 




Figure 9: An illustration of virtual control (dotted line) in specifically pinning control of a network 
generated by the BA model with iV = 10, m = mo = 3. 

Figure El is an illustration of the virtual control process in pinning controlling a network generated by 
the BA model with = 10, to = toq = 3. It can be observed that while the pinned nodes are stabilized 
onto the homogenous state x, their dynamics spread in the network as shown by the (red) dotted lines, 
which functions as the virtual control to those nodes which were not placed controllers. At the same 
time, it can be found in Fig. El^b) that the whole 10-node original network was broken into two parts: 
An isolated 1** node, which is only connected with the 4*^* node, and the rest 8-node subnetwork. While 
increasing the pinning fraction of nodes, this subnetwork continues to shrink and finally reaches the case 
as shown in Fig. El^d): every unpinned node is 'isolated' and virtually controlled by other pinned and 
also stabilized nodes. 
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Denote 

B + diag (^di+i,di+2, ■■■ ,dN 
and set F = /„. We have the following theorem on the pinning controlled network (|21|l |43j . 

Theorem 4 Assume f{x) is Lipschitz continuous in x with a Lipshitz constant > 0, and the chaotic 
node Xi = f{'x.i), for all i ^ 1,2, N, has the largest positive Lyapunov exponent /i,nax > O.If A is irre- 
ducible, then the dynamical network l^21\) with virtual controllers 1^21^} is globally (or locally asymptotically) 
stable about homogenous state x, provided that T = /„ and 



c > 



Q 



Ami„(-^) 

with Q being the Lipschitz constant L[ (or the largest Lyapunov exponent h,nax)- 



(24) 



It is very easy to verify from Theorem |21 that condition (|24|) is exactly the same stable condition for 
synchronizing network (|25|l : 



N 



±i = /(xj) + c ^ a^jTxj, 
j=i+i 



1 + 1,1 + 2, 



,iV. 



(25) 





(a) c=0,d=0 



Cb) c = m,d=\000 





(c) c=l5,d = mOO 



(A) c= 20,t^= 1000 



Figure 10: Specifically pinning the biggest node of 19 degrees in a 50-node Chen network generated 
by the BA model: (a)-(d) are stabilizing phases with different coupling strengths. The homogenous 
stationary state is x = [7.9373 7.9373 21]-^", an unstable fixed point of Chen system |15) . 

Hence, the whole pinned network, controlled by a very small amount of local feedback controllers 
and those virtual controllers, is stabilized onto the homogenous state x via synchronization ^43^^. This 
phenomenon is illustrated in Fig. llOl when the biggest node in a 50-node Chen network generated from the 
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BA model was specially pinned with suitable coupling strength c and feedback gain d, over which other 49 
coupled chaotic Chen systems |15) (i.e., nodes) in the network were synchronized to the designer-preferred 
unstable fixed point x = [7.9373 7.9373 21]^ of Chen system. 



6 Sync criticality stories on Kuramoto models 

Collective phase synchronization in a large population of oscillators having natural different frequencies is 
another main branch in the literature of network synchronization, and the Kuramoto model is one of the 
most representative models of coupled phase oscillators. After Wiener first described the mathematical 
connection between the nonlinear dynamics and statical physics j73j , which was later fruitfully studied by 
Winfree [73], Kuramoto refined the model, and formalized the solution to a network of globally coupled 
limit-cycle oscillators |36j . uncovering the situation why the oscillators are completely de-synchronized 
until the coupling strength overcomes a criticality Csyn- Many variations and extensions of the original 
Kuramoto model appeared later have been recently surveyed in (and references therein). 

We consider a network of TV coupled limit-cycle oscillators whose phases 6*^, i = 1, 2, • • • , iV, evolve as 

= + ^ ay sin(6'j - O^), (26) 

where Cij is the coupling strength between node (oscillator) i and node (oscillator) j. Frequencies uji,i = 
1, 2, • • • , iV, are randomly distributed following the given frequency distribution (?(w), which is assumed 
that g{LLi) = g{—Lo). The network coupling matrix A — {(lij) G is defined as in previous sections. 

If we select the identical coupling scheme for a globally coupled network as 

= ^ (27) 

Eq. H25|l is the classical Kuramoto model whose synchronization criticality is Cgyn — 7^0) • With 
similar constant identical coupling schemes, Kuramoto model has been investigated its criticality Csyn 
over small-world and (or) scale-free networks. Hong e£ al. reported their synchronization observations of a 
larger criticality of coupling strength on small- world networks than that of globally coupled networks |2HI ■ 
And, the latest investigation stated the absence of critical coupling strength in frequency synchronization 
of a swarm of oscillators connected as a scale- free network having a power-law exponent 2 < 7 < 3 |3U) . 
These results strongly suggest that the collective synchronous behaviors of complex networks depend on 
the network topologies. 

However, the situation is completely different when the coupling scheme is non-identical and asymmet- 
ric. Define the non- identical asymmetric coupling scheme |38| : 

c 

'^u^Cj^TT' hj ^'^r-- ,N, (28) 
where ki fits the given degree distribution P{k) of a network. Therefore, we have 

d0 c ^ 

-dT^'^' + '^T. «^jsin(0, ~ e,). (29) 
' i=i 

If for every node i, its degree ki — N,i — 1,2, N, model H29fl is degraded to the classical Kuramoto 
model for globally coupled networks. An interesting finding is that, with the non-identical and 
asymmetric coupling scheme (|28ll . there does exist a uniform criticality of coupling strength, Csyn = Trg(Q) 1 
to synchronize diversely random networks of limit-cycle oscillators H29|l . which is surprisingly the same 
as the critical coupling strength of globally coupled networks. 
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1 




Figure 11: The average order parameter rav vs the couphng strength C for networks generated by the 
ER model (dashed hne with circle markers), the Local- World model (dotted line with square markers), 
the BA model (solid line with diamond markers), and the GKK model having power-law exponent 7 = 6 
(dash-dot line with right triangle markers). All networks have the same scale TV = 2048 and the same 
average degree (fc) = 6. 

Two main categories of degree distributions of random complex networks are in the forms of Ppower{k) oc 
k^^ and P^xpik) oc e^*^. Therefore, to verify the independence of Cgyn on different degree distributions 
P{k) of network topologies, in numerical studies we select the famous ER model 20] to generate networks 
having an exponential degree distribution Pexp{k) cx e~^, and the BA model [H| and the GKK model 
|27j to generate networks having the scale-invariant power-law degree distribution Ppower{k) cx fc^'*' with 
7 = 3, 6, respectively. The proposed local-world evolving model PHI, which owns a transition between the 
exponential degree distribution and the power-law degree distribution, is adopted as the final prototype 
with the parameters M ~ 10, m = niQ = 3 |38| . 

We fix the network scale N = 2048, and the average degree (k) = 6. Therefore, all networks have the 
same number of nodes and edges with different connectivity patterns in the following simulation studies. 
Define the average order parameter as 



J2i=i ki 



(30) 



where (• • • ) and [• ■ • ] denote the averages over different realizations of intrinsic networks and over different 
realizations of intrinsic frequencies, respectively. In all the simulations, Tav is averaged over 10 groups of 
networks satisfying the same degree distribution P(fc), and each network has 5 sets of frequencies with 
the distribution g{ijj). We further specify 

.H=l°-'' ''~'<^<' (31) 
I 0, otherwise. 

Therefore, Cgyn ~ 1.273 in this case. 

As shown in Fig. 1111 there is a common critical coupling strength of the value Cgyn = gifi)-n 
these four categories of networked limit-cycle oscillators, and the average order parameter rav increased 
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sharply when Csyn < c. In other words, the significant difference among complex network topologies 
does not show effect on the collective synchrony of the non-identically asymmetrically coupled limit-cycle 
oscillators H29|) . However, as concluded from |28[l51[Onj . there is no such a same critical coupling strength 
of collective synchrony in different random complex networks of identically symmetrically coupled limit- 
cycle oscillators. 

7 An application example: Synchronization in the World Trade 
Web 

Recent studies of the World Trade Web ( WTW) |41l 1^ have shown that there is also a significant scale- 
free feature in this economic network (Fig. I12|) . In such a World Trade Web, every country is a dynamical 
node, and the connections (edges) between any pair of countries (nodes) are their imports and exports. 
It was pointed out that the United States is the biggest node in the WTW jlj. As mentioned above, 
the complexity of the network topology usually dominates the dynamical behaviors of a network, and 
the stability of a few 'big' nodes determine the synchronizability and stability of a scale-free dynamical 
network 031 EH- Therefore, it is interesting to ask to what extent the economy of the United States 
affects the economic development in other relatively 'smaller' countries. In more subtle details, we are 
interested in finding whether there is synchronization of economic cycles existing between the United 
States and the other countries. 




10° 10' lo" lo" 10* 

Weighted degree 



Figure 12: Cumulative import and export weighted degree distributions of the WTW with 188 nodes 
and 12413 export links and 12669 import links. The dashed line is the power-law form P{k) ~ k ' with 
7 = 0.6 ~ 1.6. 

The economic-cycle synchronization is characterized by the correlation between the cyclical components 
of outputs of two arbitrarily chosen countries, i and j |24l I25| : 

corr{yly'^)= , z, j = 1, 2, • ■ • , n , (32) 

J var{yf)var{y^) 

where is the cyclical component of output of country i, which can be specified here as the real Gross 
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Domestic Product (GDP). A positive correlation means that synchronization exists in the economic cycles 
between countries i and j, and a higher correlation implies a higher degree of synchronization of economic 
cycles between two countries. 

The economy development in a country is a very complex issue, and may be affected by many unpre- 
dictable factors such as significant changes of economic or political regimes occurred in a country (like 
USSR and some eastern European countries), the shocks from those speculated money firms (such as the 
Quantum Fund of George Soros), the continuation of a country's economic policy, the change of exchange 
rate policy, and local wars, etc. Hence, in studying the synchronization phenomenon of economic cycles, 
to decrease the perturbations on economy development from unreasonable 'noise' to the minimum, we 
should probe those countries where stable and peaceful political situations and mature market economic 
systems have been well maintained. With the statistical data of real GDP in 1975-2000 that we can 
collected at that time, an appropriate choice contains 22 developed countries, i.e., the United States, the 
United Kingdom, Germany, Japan, France, Canada, Australia, Austria, Belgium, Norway, Italy, Finland, 
Denmark, Greece, Ireland, Iceland, Netherlands, Portugal, Spain, Sweden, New Zealand and Luxemburg 
(Fig. I13|l . It can be observed from the figure that in 1975-2000, totally 18 developed countries did 
have significant economic-cycle synchronization with the United States, where 5 countries (the United 
Kingdom, Australia, Canada, Finland, Sweden) show much stronger synchronization of economic cycles, 
except only 3 countries: Japan, Germany and Austria (3 Ij . 




2 4 6 8 10 12 14 16 18 20 22 



Countries 

Figure 13: 22 developed countries' economic cycles synchronization phenomena. The positive real GDP 
correlation means synchronous economic cycles of those indicated countries with the United States, and 
the negative correlation means asynchronous economic cycles of the indicated countries with the United 
States. 

8 To probe further 

In the past few years, advances in complex dynamical networks have uncovered some amazing similarities 
among many diverse large-scale natural and artificial systems such as the Internet, the world wide web, 
the world trade web, cellular nonlinear networks, metabolic systems, and even the collaborations of the 
Hollywood movie stars. Researchers from inter-disciplines have been inspired by the newly discovered 
small-world and scale-free features, and significant progress has been gained in the studies of the effect 
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of complex network topology on network dynamical behaviors, particularly the network synchronization 
phenomenon. 

In this article, we have reported our recent research work on the synchronization of complex dynamical 
networks, both from the theoretical studies and economic applications. Even with the inspiring advances 
of today, there are still many important theoretical and technical explorations on modelling, evolution, 
analysis, control, and synchronization of complex dynamical networks left for future persistent research. 
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